Papers with speech-based VQA system
Towards Multilingual spoken Visual Question Answering system using Cross-Attention (2025.coling-main)
Copied to clipboard
| Challenge: | Visual question answering (VQA) is a multi-modal translation challenge that requires the analysis of both images and questions simultaneously to generate appropriate responses. |
| Approach: | They propose a textless multilingual visual question answering dataset that incorporates speech-based questions in English, german, spanish and french. |
| Outcome: | The proposed framework is superior to existing frameworks for speech-based VQA . the proposed framework can generate better results for image, text and audio representations . |